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In the claims: 

1. (cancelled). 

2. (cancelled). 

3. (cancelled). 

4. (withdrawn): A method of enabling a user to create an instance in a formal language 
of the kind which has a strictly defined syntax, comprising 

providing a graphically displayed list of entries which are expressed in natural language 
and which do not comply with said syntax, 

permitting the user to point to an entry on said list, and 

automatically generating said instance corresponding to the identified entry in the list in 
response to said pointing. 

5. (withdrawn): A method of generating a table for aiding conversion of voiced 
utterances to control commands for use in controlling an operating system of a computer to 
achieve desired actions in an application program running under the operating system, said 
application program including menus and control buttons, said method comprising 

automatically by computer parsing an application program to identify menu 
entries and control buttons, and 

automatically by computer placing a table entry in said table for each menu entry 
and control button found in the application program, each table entry placed in said table 
containing one of said control commands corresponding to said menu entry or control button. 

6. (previously presented): A voice user interface system for producing input to a 
computer, said computer having a display, said display having a pointer indicating a position on 
said display, and a program for execution on said computer, a state of said program comprising a 
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configuration on said display, said configuration being associated with control of said program, 
the system comprising 

a voice recognizer for recognizing a voiced utterance and for providing corresponding 
signals as input to said computer, and 

a converter for converting said voiced utterance into a command string including a 
command directing motion of said pointer relative to said configuration 

7. (previously presented): The system of claim 6 wherein said command string further 
comprises a command to said program. 

8. (previously presented): A voice user interface system for recognizing a voiced 
utterance and producing corresponding input to a program for execution on a computer, 
comprising 

a voice recognizer for recognizing a voiced utterance and for providing a corresponding 
signal as an input to said computer, and 

a converter for converting said voiced utterance to an output string for delivery as input 
to said computer based on an evaluation of said voiced utterance and on a state of the subsystem 
comprising said voice recognizer and said converter. 

9. (previously presented): A voice user interface system for recognizing a voiced 
utterance and producing corresponding input to a program for execution on a computer, 
comprising 

a voice recognizer for recognizing a voiced utterance and for providing a corresponding 
signal as an input to said computer, and 
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a converter for converting said voiced utterance to an output string for delivery as input 
to said computer based on an evaluation of said voiced utterance and on a state of said program. 

10. (previously presented): The system of claim 9 further comprising commands to said 
program having a format to carry associated text strings as arguments, further comprising means 
for converting a series of voiced utterances into commands with said associated text as output of 
said device. 

11. (previously presented): The system of claim 9 wherein said program, when operated 
without said converter, offers to its user, menu selections that said user selects via keyboard 
input, and wherein said converter, when used to select the same menu selection based on a 
voiced utterance, produces a series of operating system events in response to said keyboard 
input. 

12. (previously presented): The system of claim 9 wherein said operating system of said 
computer maintains an event queue, said converter delivering said output string to said event 
queue. 

13. (previously presented): A system for enabling voiced utterances to be substituted for 
manipulation of a pointing device to control motion of a displayed location indicator on a 
computer display, 

the indicator being moved by an operating system in a computer in response to control 
signals received from the pointing device, comprising 

a voice recognizer for recognizing a voiced utterance, and 

an interpreter functionally connected to said voice recognizer for converting a voiced 
utterance into control signals which will cause movement of the indicator in a desired direction 
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aided by the operating system in the computer, said movement continuing unabated until stopped 
by an action of the user. 

14. (previously presented): A voice user interface device comprising 

means for converting a voiced utterance into a corresponding signal as an input to a 
computer, 

means for converting a voiced utterance as either one to be converted to said signal or as 
one to be converted to said command. 

15. (previously presented): A voice user interface system for recognizing a voiced 
utterance and producing corresponding input to a program for execution on a computer, 
comprising 

a voice recognizer for recognizing said voiced utterance, 

a converter for converting said recognized voiced utterance to an output string of 
characters or commands for input to said computer, 

a set of representations, one such representation for each voiced utterance recognized by 
said voice recognizer, said representations internal to said voice recognizer and said converter, 

a set of output strings produced by said voice recognizer and said converter as input to 
said program, and 

a mapping from a member of said set of internal representations to a member of said set 
of output strings, said mapping being multiple-to-one and being used by said converter. 

16. (withdrawn). 

17. (withdrawn). 

18. (withdrawn). 
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19. (withdrawn). 

20. (withdrawn). 

21. (withdrawn). 

22. (withdrawn). 

23. (withdrawn). 

24. (withdrawn). 

25. (withdrawn). 

26. (withdrawn). 

27. (withdrawn). 

28. (withdrawn). 

29. (withdrawn). 

30. (withdrawn). 

31. (withdrawn). 

32. (withdrawn). 

33. (withdrawn). 

34. (withdrawn). 

35. (new): A method for use with a machine having a graphical user interface and an 
application program, the method comprising: 

the graphical user interface enabling a user to launch the application program; 
receiving a voiced utterance from a user; and 

launching the application program in response to the received voiced utterance. 
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36. (new): The method of claim 35 in which an operating system provides the 
graphical interface. 

37. (new): The method of claim 35 in which the graphical user interface is shown on 
a display. 

38. (new): The method of claim 35 in which the machine comprises a computer. 

39. (new): The method of claim 35 in which there are multiple application programs 
and also comprising: 

the graphical user interface enabling a user to launch each of the application programs, 

and 

launching at least one of the application programs in response to the received voiced 
utterance. 

40. (new): The method of claim 1 in which 

there are multiple application programs, an operating system provides the graphical user 
interface, the graphical user interface is shown on a display, and the machine comprises a 
computer. 

the graphical user interface enabling a user to launch each of the application programs, 

and 

launching at least one of the application programs in response to the received voiced 
utterance. 

41 . (new): A method for use with a machine having a pointing device, and a 
graphical user interface that includes a cursor and at least one other graphical item, the method 
comprising: 
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receiving a voiced utterance from a user; and 

manipulating the one other graphical item in response to receiving the voiced utterance. 

42. (new): The method of claim 41 in which an operating system provides the 
graphical user interface. 

43. (new): The method of claim 41 in which the graphical user interface is shown on 
a display 

44. (new): The method of claim 41 in which the machine comprises a computer. 

45. (new): The method of claim 41 in which there are multiple other graphical items, 
the method also comprising 

manipulating at least one of the other graphical items based on the voiced utterance that 
is received. 

46. (new): The method of claim 45 in which the one other graphical item comprises a 
window. 

47. (new): The method of claim 46 in which manipulating the one other graphical 
item comprises performing a graphical operation on the window. 

48. (new): The method of claim 47 in which the graphical operation comprises 
closing the window. 

49. (new): The method of claim 47 in which the graphical operation comprises 
moving the window. 

50. (new): The method of claim 47 in which the graphical operation comprises 
zooming the window. 
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51 . (new): The method of claim 47 in which the graphical operation comprises 
moving the window toward the front or rear of a stack. 

52. (new): A method for use with a machine having a pointing device and an 
operating system providing a graphical user interface that includes a menu that may be invoked 
in response to the pointing device, the menu including selectable menu items associated with 
respective functions that may be performed, the method comprising: 

receiving a first voiced utterance from a user; and 

displaying the menu in response to receiving the first voiced utterance. 

53. (new): The method of claim 52 in which there are multiple menus that may be 
invoked in response to the pointing device, each of the menus including selectable menu items 
associated with respective functions that may be performed. 

54. (new): The method of claim 52 in which the graphical user interface is shown on 
a display. 

55. (new) The method of claim 52 in which the machine comprises a computer. 

56. (new) The method of claim 52 also including receiving a second voiced 
utterance from a user; 

in response to receiving the second voiced utterance, performing a function associated with a 
menu item included on said displayed menu. 

57. (new): The method of claim 56, also comprising, in response to the second voiced 
utterance, modifying the appearance of the included menu item. 



t • 

ian^ Attorney 



Applicant : Thomas R. Firman^ Attorney's Docket No.: 10591-003008 

Serial No. : 09/783,725 

Filed : February 14, 2001 

Page 10 of 10 



Please apply any charges or credits to Deposit Account No. 06-1050, reference 10591- 



003008. 



Date: 



Fish & Richardson P.C. 
225 Franklin Street 
Boston, MA 02110-2804 
Telephone: (617) 542-5070 
Facsimile: (617) 542-8906 



Respectfully submitted, 




Feigenbaum 
Reg. No. 30,378 



20752405.doc 



